Skip to main content

Retrying

Project description

Retrying is an Apache 2.0 licensed general-purpose retrying library, written in Python, to simplify the task of adding retry behavior to just about anything.

The simplest use case is retrying a flaky function whenever an Exception occurs until a value is returned.

import random
from retrying import retry

@retry
def do_something_unreliable():
    if random.randint(0, 10) > 1:
        raise IOError("Broken sauce, everything is hosed!!!111one")
    else:
        return "Awesome sauce!"

print do_something_unreliable()

Features

  • Generic Decorator API

  • Specify stop condition (i.e. limit by number of attempts)

  • Specify wait condition (i.e. exponential backoff sleeping between attempts)

  • Customize retrying on Exceptions

  • Customize retrying on expected returned result

Examples

As you saw above, the default behavior is to retry forever without waiting.

@retry
def never_give_up_never_surrender():
    print "Retry forever ignoring Exceptions, don't wait between retries"

Let’s be a little less persistent and set some boundaries, such as the number of attempts before giving up.

@retry(stop_max_attempt_number=7)
def stop_after_7_attempts():
    print "Stopping after 7 attempts"

We don’t have all day, so let’s set a boundary for how long we should be retrying stuff.

@retry(stop_max_delay=10000)
def stop_after_10_s():
    print "Stopping after 10 seconds"

Most things don’t like to be polled as fast as possible, so let’s just wait 2 seconds between retries.

@retry(wait_fixed=2000)
def wait_2_s():
    print "Wait 2 second between retries"

Some things perform best with a bit of randomness injected.

@retry(wait_random_min=1000, wait_random_max=2000)
def wait_random_1_to_2_s():
    print "Randomly wait 1 to 2 seconds between retries"

Then again, it’s hard to beat exponential backoff when retrying distributed services and other remote endpoints.

@retry(wait_exponential_multiplier=1000, wait_exponential_max=10000)
def wait_exponential_1000():
    print "Wait 2^x * 1000 milliseconds between each retry, up to 10 seconds, then 10 seconds afterwards"

We have a few options for dealing with retries that raise specific or general exceptions, as in the cases here.

def retry_if_io_error(exception):
    """Return True if we should retry (in this case when it's an IOError), False otherwise"""
    return isinstance(exception, IOError)

@retry(retry_on_exception=retry_if_io_error)
def might_io_error():
    print "Retry forever with no wait if an IOError occurs, raise any other errors"

@retry(retry_on_exception=retry_if_io_error, wrap_exception=True)
def only_raise_retry_error_when_not_io_error():
    print "Retry forever with no wait if an IOError occurs, raise any other errors wrapped in RetryError"

We can also use the result of the function to alter the behavior of retrying.

def retry_if_result_none(result):
    """Return True if we should retry (in this case when result is None), False otherwise"""
    return result is None

@retry(retry_on_result=retry_if_result_none)
def might_return_none():
    print "Retry forever ignoring Exceptions with no wait if return value is None"

Any combination of stop, wait, etc. is also supported to give you the freedom to mix and match.

Contribute

  1. Check for open issues or open a fresh issue to start a discussion around a feature idea or a bug.

  2. Fork the repository on GitHub to start making your changes to the master branch (or branch off of it).

  3. Write a test which shows that the bug was fixed or that the feature works as expected.

  4. Send a pull request and bug the maintainer until it gets merged and published. :) Make sure to add yourself to AUTHORS.

History

1.4.0 (2025-06-24)

  • Require Python 3.6+

1.3.6 (2025-06-24)

  • Restore Python 2 compatibility

1.3.5 (2025-06-22)

  • Remove six dependency

  • Add basic logging support

  • Fix tests and add GHA

  • Accept Exception type for retry_on_exception

1.3.4 (2022-09-03)

  • Added Greg Roodt as maintainer

  • Formatted code with black

  • Updated repository references

1.3.3 (2014-12-14)

  • Add minimum six version of 1.7.0 since anything less will break things

1.3.2 (2014-11-09)

  • Ensure we wrap the decorated functions to prevent information loss

  • Allow a jitter value to be passed in

1.3.1 (2014-09-30)

  • Add requirements.txt to MANIFEST.in to fix pip installs

1.3.0 (2014-09-30)

  • Add upstream six dependency, remove embedded six functionality

1.2.3 (2014-08-25)

  • Add support for custom wait and stop functions

1.2.2 (2014-06-20)

  • Bug fix to not raise a RetryError on failure when exceptions aren’t being wrapped

1.2.1 (2014-05-05)

  • Bug fix for explicitly passing in a wait type

1.2.0 (2014-05-04)

  • Remove the need for explicit specification of stop/wait types when they can be inferred

  • Add a little checking for exception propagation

1.1.0 (2014-03-31)

  • Added proper exception propagation through reraising with Python 2.6, 2.7, and 3.2 compatibility

  • Update test suite for behavior changes

1.0.1 (2013-03-20)

  • Fixed a bug where classes not extending from the Python exception hierarchy could slip through

  • Update test suite for custom Python exceptions

1.0.0 (2013-01-21)

  • First stable, tested version now exists

  • Apache 2.0 license applied

  • Sanitizing some setup.py and test suite running

  • Added Travis CI support

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

retrying-1.4.0.tar.gz (11.2 kB view details)

Uploaded Source

Built Distribution

retrying-1.4.0-py3-none-any.whl (12.0 kB view details)

Uploaded Python 3

File details

Details for the file retrying-1.4.0.tar.gz.

File metadata

  • Download URL: retrying-1.4.0.tar.gz
  • Upload date:
  • Size: 11.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.6

File hashes

Hashes for retrying-1.4.0.tar.gz
Algorithm Hash digest
SHA256 efa99c78bf4fbdbe6f0cba4101470fbc684b93d30ca45ffa1288443a9805172f
MD5 f617392cfc10a7310a62252471548d92
BLAKE2b-256 4ee5986cabb44cc073a8bf50c3d8d4c85514c6741fff78ebf853a0ebcd441a97

See more details on using hashes here.

File details

Details for the file retrying-1.4.0-py3-none-any.whl.

File metadata

  • Download URL: retrying-1.4.0-py3-none-any.whl
  • Upload date:
  • Size: 12.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.6

File hashes

Hashes for retrying-1.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 6509d829c70271937605bce361c8f76e91f9123d355d14df7dc6972b1518064a
MD5 b1bc98ab95b62d337a7c0cc876cfe29d
BLAKE2b-256 967e5a83e2c56761d347128e58b3f23af829fd145bfb1afeff18927bc5915459

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page